Monetary Interventions in Crowdsourcing Task Switching
نویسندگان
چکیده
With a large amount of tasks of various types, requesters in crowdsourcing platforms often bundle tasks of different types into a single working session. This creates a task switching setting, where workers need to shift between different cognitive tasks. We design and conduct an experiment on Amazon Mechanical Turk to study how occasionally presented performancecontingent monetary rewards, referred as monetary interventions, affect worker performance in the task switching setting. We use two competing metrics to evaluate worker performance. When monetary interventions are placed on some tasks in a working session, our results show that worker performance on these tasks can be improved in both metrics. Moreover, worker performance on other tasks where monetary interventions are not placed is also affected: workers perform better according to one metric, but worse according to the other metric. This suggests that in addition to providing extrinsic monetary incentives for some tasks, monetary interventions implicitly set performance goals for all tasks. Furthermore, monetary interventions are most effective in improving worker performance when used at switch tasks, tasks that follow a task of a different type, in working sessions with a low task switching frequency.
منابع مشابه
Predicting Crowd Work Quality under Monetary Interventions
Work quality in crowdsourcing task sessions can change over time due to both internal factors, such as learning and boredom, and external factors like the provision of monetary interventions. Prior studies on crowd work quality have focused on characterizing the temporal behavior pattern as a result of the internal factors. In this paper, we propose to explicitly take the impact of external fac...
متن کاملAn Empirical Analysis of System-generated Data in Location-based Crowdsourcing
This paper develops a research model explaining how task location and incentives affect the take up and, for those tasks that are processed, the time to start. For an empirical analysis, we use the system-generated data of all 1860 location-based crowdsourcing tasks in Berlin available on the Streetspotr platform within one year. The results indicate that while the population density of the tas...
متن کاملAsymmetric Effects of Monetary Policy and Business Cycles in Iran using Markov-switching Models
This paper investigates the asymmetric effects of monetary policy on economic growth over business cycles in Iran. Estimating the models using the Hamilton (1989) Markov-switching model and by employing the data for 1960-2012, the results well identify two regimes characterized as expansion and recession. Moreover, the results show that an expansionary monetary policy has a positive and statist...
متن کاملA Field Trial on Mobile Crowdsourcing of News Content Factors Influencing Participation
We conducted a five-week field trial on mobile crowdsourcing of hyperlocal news content to 1) understand the readers’ experiences and 2) explore factors affecting their participation. In the end of the study the participants were surveyed with an online questionnaire (17/104 respondents) and five participants were interviewed. Although respondents and interviewees were enthusiastic about the tr...
متن کاملPerform Three Data Mining Tasks with Crowdsourcing Process
For data mining studies, because of the complexity of doing feature selection process in tasks by hand, we need to send some of labeling to the workers with crowdsourcing activities. The process of outsourcing data mining tasks to users is often handled by software systems without enough knowledge of the age or geography of the users' residence. Uncertainty about the performance of virtual user...
متن کامل